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INTRODUCTION 

A recent addition to the tools of management and production engi- 
neering is the technique of linear programming. The purpose of this 
project, a result of a survey of literature in this field, is to sum 
màrize the fundamentals of linear programming. Toward that objective, 
the following phases are presented: a summary of the mathematical con- 
cepts involved, three methods of solution and their characteristics, 
and the significance of the dual theorem. The general form, the simplex 
method, and two of its special cases, the transportation method and the 
assignment method are presented. Two basic references for the mthe- 
matics of linear programming are references (1) and (lh). 

The names of the special cases should not be taken literally. For 
example, the transportation method may be used for problems with no 
physical transportation involved. Similarly, the assignment method may 
be used in quality control, purchasing, set up time, and such other di- 
verse problems. In the development of the special cases, the type of 
problem was essentially the same as the name implied, but in recent 
years the methods have been applied to a variety of problems. 

The general form, the simplex method, was developed by Dantzig.” 
Most of the work in the field of linear programming has been conducted 
by economists, mathematicians, and consulting firms. However, the num- 
ber of qualified personnel for this type of work is limited compared 
to the needs of industry. The usefulness of mathematical programming 
depends to a large extent on the ingenuity of the personnel formulat- 
ing the mathematical model. Many management and technical publications 
contain reports on the use of tnis type of programming but are neces- 
sarily brief due to publication requirements and other factors. 
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It should be noted that many of the calculations involved in lin- 
ear programming can be handled in a routine fashion utilizing desk cal- 
culators, but a large scale problem is better solved by computers. 
Regarding the use of desk calculators, one of the advantages of linear 
programming is that the mechanics of solution are simple and may be 
handled by lesser skilled personnel to obtain the best solution to a 
given problem. This characteristic should be borne in mind as an aid 
in freeing engineering and management personnel for more demanding work 
commensurate with their training. The most important phase of the pro- 
gramming solution is that of setting up the initial problem. Once this 
has been done, the mechanics can be performed by clerical personnel. 

Operations research, operations analysis, and mthematical pro- 
graming have received wide publicity since World War II. The majority 
of the research and application was conducted during World War II, and 
management is now in the process of utilizing some of the methods in 
industry. There is an abundance of literature concerning the above 
topics and no attempt will be made to describe or discuss those fields. 
Essentially, linear programming is a method or technique within the 
field of mathematical programming, and attention will be limited to 
that phase. 

Linear programming is a systematic mathematical approach to a 
given problem to arrive at an optimal or best solution. It involves 
an objective and a set of restrictions or constraints. The procedure 
has been effectively used in industrial problems where a large number 
of alternative choices were available. From case histories published, 
it may be said that the usefulness of the method is proportional to 


the size and complexity of the situation. Until more research has been 








3 
conducted, some industries may not be able to use linear programming to 
its full capacity. However, by examining a local problem for applica- 
tion and trying to formulate the problem by the methods of linear pro- 
graming, possible cost and time savings may be realized. 

One of the limitations of the method is the requirement of linear- 
ity of the variables involved, Due to this restriction, all variables 
such as time, cost, and quantity must be of the first order. That is, 
the ratio of input to output must be a fixed ratio and independent of 
the level of production or process involved. For example, if one unit 
of input results in one unit of output then ten units of input must re- 
sult in ten units of output. Dorfman? has summarized the basic assump- 
tions of linear programming as follows: 

l. The productive opportunities of an economy or economic 

unit are defined by the resources and the productive 
processes available to it. The quantities of at least 
some of the resources are finite and so is the number 
of productive processes available. 

2. Any productive process may be used at any positive level 
consistent with the supply of resources available. The 
consumption of resources and the output of products is 
proportional to the level at which the process is used. 

3. Several productive processes may be used simultaneously 
if the supply of resources is adequate. If this is done, 
the consumptions of the individual processes used, and 
the output of products is the sum of the outputs of the 
individual processes. 

Dorfman? further reduces the three assumptions to the following 

postulates: 

a. Linearity. By definition, in linear programming, each 
process is characterized by certain ratios of the quan- 
tities of the inputs to each other and to the quantities 


of each of the outmuts. These ratios are defined to be 


constant and independent of the extent to which the proc- 
ess is used. 








b. Divisibility. It is assumed that any process can be 
used to any positive extent so long as sufficient re- 
sources are available; indivisibilities and "lumpiness" 
in production are ignored. 

Ce Additivity. It is assumed that two or more processes 
can be used simultaneously, within the limitations of 
available resources, and that if this is done the quan-: 
tities of the outputs and inputs will be the sums of 
the quantities which would result if the several proc- . 
esses were used individually. 


d. Finiteness. It is assumed that the number of processes 
available is finite. 


The terms: resources, products, and production processes have very 
broad meanings as used above and are not limited to the concepts often 


used in industry. 


Programming in this sense may be considered as arriving at the solu- 
tion systematically; the term stems from the "activity analysis" approach 
of reference (hl). The objective of a problem may be to minimize or maxi- 
mize some function such as time, cost, or material. The constraints may 
be set by machine time available, raw materials, capital to be invested, 
time in transportation, quantity to be produced, or other restrictions. 
Initially, the particular problem is formulated mathematically into a 
set of inequalities with more variables present than the number of equations. 
If it is possible to set up as many equations as variables present, then the 
obvious method is a solution by Simultaneous equations. However, in such an 
approach negative answers may result, and this situation may also be PRO 
by linear programming. A condition warranting the application of linear pro- 
gramming is that there exist a large number of alternative choices in which 
any one choice of a subordinate phase will affect the outcome of the entire 
plan. If there is adequate machine time available in a plant for a particu- 


lar product, there is still an advantage in using the method. However, if 








a number of products can be processed on any number of machines in a 
plant, a trial and error procedure is far too time consuming, and even 
then the solution may not be the best one. The word scheduling is pur- 
posely omitted here for if the problem involves a decision on sequence 
of operations, present methods of linear programming cannot handle this 
completely. Research is being conducted along this line such as noted 
in reference (5). 

Charnes© has described a linear programming problem as follows: 
If a problem can be written in the following forn, 

Given a criterion of choice 

n 
(1) = ¢ 3x4 which is to be minimized or maximized, and is subject 


to the two types of constraints or conditions that follow: 


n 
(2) 2. ES < b; 9 all = 15 = Basel, and 
jel 
(3) x, >20, j=1, 2, 3....n; then the problem is a 


linear programming problem. 

Here, the objective is the criterion of choice (1), and the con- 
straints are contained in (2) and (3). For maximizing, the following 
meanings may be associated with the variables: 

xy=a variable to be determined such as the quantity of a part or 


a product. 


O 
u 


profit per unit. 


ajj =a capacity constraint such as a unit production time. 


o” 
tt 


4 = a stipulation such as production capacity expressed in time 


available. 
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Although solution to the following problen is obvious, it is pre- 
sented to show formulation to the above conditions. Suppose there are 
two products Pi and E , one machine available that can produce ei- 


ther produci, and the available machine time is 8 hours. 








5 Pa 
Xj - units to produce X, = units to produce 
2 hrs = production time per unit lh hrs = production time per unit 
$1.00 = unit profit $2.00 = unit profit 


Problem: 


(1) $4.00 x, + $2.00 x maximize profit 


DIT 
(2) 2 hrs x, + 3 hrs x $ 8 hrs 


x.20,and x4,20 


1 2 
Aside from product demands or promised delivery, the answer is apparent 
by inspection. However, as the number of products, machines, or produc- 
tion paths available increase and product demands are considered, the 
problem becomes proportionally complex. The linear programming method 
is carried out by successive steps, and if a solution is possible, a 
maximum profit case will be reached. Also, lower profit cases can be 
considered for factors such as balancing machine time or other economic 
reasons. 

Regarding the construction of the mathematical model, Bellman! has 
described operations of a multi-stage process to be of two types: de= 
terministic and stochastic. Deterministic may be considered as mom 
data, the solution being completely determined for each choice of al- 
ternative, whereas stochastic data involves a probability distribution 


of some forme References (27) and (28) discuss methods where probability 








7 
considerations are given both to the functional and to the constraints 
involved. Drawing an analogy in the field of mechanics concerning the 
use of statics or dynamics, there is as large a fielc of application in 
Industrial Engineering for use of the deterministic concept as of the 
stochastic concept. 

Many examples of linear programming emphasize a solution for the 
number of products to produce, ship, buy, or similar functions. How- 
ever, one of the most useful attributes of a linear programming solu- 
tion is that of cost analysis and the effect of changing constraints or 
Stipulations such as minimum or maximum requirements, unit time, unit 


cost, unit rates, and similar factors. 








MATHEMATICS OF LINEAR PROGRANMING 

This section is a summary of the basic mathematical tools and 
concepts involved in linear programming. It is not all inclusive but 
contains the essential features normally encountered in the literature 
concerning this field. References should be consulted for precise 
definitions and details. 

MacDuffe® points out that the importance of matrix theory derives 
from the rules of combination of matrices and the fact that they may be 
represented as square arrays is incidental. The term "tableau," as used 
in linear programming for the tabular array, indicates the array to be 
a member of matric algebra. The tableau is also referred to as a frame, 
since it describes the convex hull of the polyhedral cone by means of 
half lines spanning the cone. 

Notation 
Summations. 

A series of values, knovm or unknowm, may be given as: 

a7X + ax, + an, + ay X) + acXe ee. tan 


Or more compactly: 


n 
5 a3 3 J = 15 23 s e « eli 
jel 
For a set of expressions: 
n 
n 
ES 
8a.4X4 d- a. seo ay Xs sec te ao cee = an i = row 
T. 932 iJ j 1π η = 1) en 
n 
ag + an2 2 eco ass 5 as Xs izm 
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The matrix of this set may be denoted by Ca, J or A , with each ele- 


ment a corresponding to the element in the ith row and zen col- 


ums. 


If the column values of each X; are not identical, the above may 


be extended to use of a double sumnation: 


Where the corresponding elements, a and X: 


ij 
are multiplied and summed for total value. 


i J 
a. : 

i=l j=l if'ij 

In matrix notation the set of expressions may be shom as: 


A E 
y : 
1) ae = > aif; 12 Ibe 2, 35.51 
x 


Inequalities and Equalities, 
Symbols used: 
y>x y is greater than x 
y 2x y is greater than or equal to x 
E y x is less than y 
x<S y x is less than or equal to y 
These symbols represent such restrictions as "produce no more than," 
"stock no less than," "pay no more than," "produce at least," etc. In 
the above examples the latter two were obtained by reversing the symbol 
and order of variables. However, in solving a problem containing a set 
of mixed inequalities, it is necessary to make the system consistent. 
This is carried ovt by multiplying through by minus one, which reverses 
the inequality and preserves the order of variables. 
Example: x, + x,+ X, > y 


x, + Xy +x,$2 


Depending on the problem being solved (maximize or minimize), either 








10 
inequality may be multiplied through by minus one, giving: 
- X “Xo-X3%-Y Xy + X2TF X4 2y 


or 


= 
X, +X, +x, <2 “χι "Χρ X,2-2 


l 2 3 3 


Matrices 
Essentially, matrices are sets of numbers, real or complex, ar- 
ranged in rectangular arrays and which obey certain rules of multipli- 
cation. 
Matrix. A rectangular array of elements arranged in m rows and n 
columns. The matrix is of order (m, n). It is written as a (mm) 
matrix. If mz n, it is termed a square matrix of order n. 


Example: |a a a ... 2 


πο 135 1n 
219 ^02 3509 09e non ατα ο... 
A= ee) ο 
a a a eee a ij d = 15 2 e «e e ell 
po IE 3n 
99999 9 96969 9 Φ 99 4999 98 όφουο Where a . 19 each element. 
a a a a ij 
ml ?m2 *m3 *** *m 


Diagonal Matrix. A square matrix having all off diagonal elements equal 
to zero. The diagonal elements may equal any value except zero. 
Example: . ο ο 

O 3-0 

ο ο 
Unit Matrix. A diagonal matrix having diagonal elements equal to unity 
and off diagonal elements equal to zero. 
Example: l O Ὁ 

This matrix is also symmetric because 
τυ το 


the matrix is equal to its transpose. 
ο ολ 








I 
Transpose of a Matrix. The transpose of a matrix is obtained by inter- 
changing rows and colums and is denoted by a prime. 
Example: 122222 LAS 
A= |3 2 1 » Transpose = |2 2 3| sA' 
2.033 12123 
Row Vector. A set of n numbers in a row, a matrix of order (1, n). 
fa} = (3,5 82 Az seee a) 
Colum Vector. A set of m numbers in a colum, a matrix of order 
im. 1). 
ες 
b 
3 


Pm 
Addition. To add, both matrices must have the same number of rows and 
columns, corresponding elements are added. 
Subtraction. The same rule applies as for addition with corresponding 
elements subtracted. 
Multiplication of Two Matrices. Matrix multiplication is defined such 
that linear transformations may be concisely and conveniently expressed. 
Two matrices can be multiplied only if the number of rows in the first 
matrix is equal to the number of columns in the second matrix. If this 
condition is satisfied the matrices are said to be conformable. The re- 
sult of this multiplication is a matrix with the number of rows equal 
to the number of rows in the first matrix, and the number of columns 
equal to the number of colums in the second matrix. Elements of the 
product matrix are obtained by multiplying a row of the first matrix 


by the same numbered colum of the second matrix. 








b + + 
Examples: 81} 312 9333 x (a, x 2107 8132) 
= + F 
So ορ οι (a,,x t angy + 22,2) 
a a a 2 (a. x ta da 2) 
31 “32 °33 3 o. 


(x y z] 41} 392 443 
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23 
33 


a 


31 %2 
= [(xa,, + yao] + za 31 )(xa,,+ Jano + 2a,,)(xa], + Yao, + 2a44)] 
Multiplication of a row vector by a column vector results in a scalar, 
Ca, a, a3] b,| = (a,b,+ a,b, + azb3) 
po 
be 
Multiplication of a Matrix by a Scalar. Each element of the matrix is 
multiplied by the scalar. 
Division by a Matrix. Division by a matrix is performed by multiplica- 
tion of its inverse. 
Example: AB=C 
Β-λ ο, and a=prtc 
Inverse of a Matrix. The inverse of a matrix A is written as A“Í, 
The product of a matrix and its inverse is the unit matrix I, 
ΑΛΓ} 2 Andas 1 
Elimination Method of Finding the Inverse.© For a matrix with a number 
of zeros present, the elimination method may be simpler than the cofac- 
tor method. In general, it should not be used if there are two or more 


identical colwms present in the original matrix. 
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Example :° 
A= [811] a(k) denotes the kt colum of matrix A 
written in terms of ı(k) and the co- 
efficients of a(k), 
(k) denotes the kt) colum of the inverse 
matrix AT. 
A= 1100 A(1) = 1(1)+27(2) +37(3) 
ο Αμ Α(2) = τ(2) 4-μτ(3) 
πι πος. 1(3) 


Solving for the I's in terms of the A's, 
TL) = 401) - 211214 64035)  mherefore, AT*?=Í| 1 0 0 
1(2) = a2) = na (3) 2 LFO 


“a 


(3) = (3) 5- 1 


Vectors and Points in Space 
The method of linear programming consists of examining various 
points in space. A point in space may be considered by its coordinates 
alone or by a position vector terminating at that point, tne position 
vector being determined by the coordinates and the origin of the systen. 
In a 3 coordinate system (x, y, Z) the unit vectors along each axis have 
a magnitude of unity. These vectors may be referred to as i, j, andk, 


and a point in space may be expressed in terms of these vectors. 





x Fig. 1 Unit Vectors 








y; 
Disregarding unit vectors for the moment, the segment joining two points 


in space in terms of other vectors is shovm in Figure 2. 





Fig. 2 Line Segment 


By analytic geometry, the line segment Pg to P, is described and 
generated in terms of vectors A and B by mB-r(1-m)A , where 
onsi. 
Points in Space. 

A point in space may be expressed in terms of the unit vectors 


along each axis and a scalar. 





Fig. 3 Points in Space 


Let Py = f(x,y2) x = L,. το. -- 
Then Pa = xi + yaj + 2ak = 1 + 23 © 3k 
Let Pg z f(x,y,z) x=2,yel,2=2 


Then Py = xpi + ypj + Zpk = 2i+ hj + 2k 
+ = i 
Pa Pa (x, + x,)i + (y, + Yn) J + £A πο 2, )K 


Po = 


P,+ Pa = (1+ 2)i+(2+ HIHI 4 2ie a 3 Ho ος 
The effect of multiplying each vector by a scalar is a multiplica- 
tion of each unit vector. 
Thus: 3P, = 3(x,i t yj + z,k) = 3x,i + 3y,j + 3z,k = 31 + 65 + 9k 
25 Ξ 2(xpi + ypj + 2pk) = pi + 2ypi + 22,k = hit 85 + hk 
3P, + 2P, = (3x, t 2p)i + (3y, + 299) +(32, + 2p)k = 
(BUE LS +83 + (+1) e T1 SEIT EE 


Vectors or points Pa B Pa and Po may be expressed as column or row 


vectors: 


Pa = XA or CX); JA» Zao) = [1 2 3) 
YA 


an 


or [xp Jp» 25) = [2 L 2) 


NED Oy ο y 


B65] 


or [σο, yo; zc) 


c 
ON Vo 


20 5 
Because of the large number of variables involved in a linear pro- 
gramming problem and the use of (1, 2, 3 ...m) dimensions, the axes are 
expressed by numerical subscripts. For a three dimension system the 


axes are normally expressed as χι » Χρ and X4 5 for an m dimension 


16 
systen xi, X55 X4 ex). The concept of unit vectors is implicit 
and they are not normally written. 

In the previous example the unit vectors may be expressed as row 
or column vectors in the form i or (i jk) 


k 


pos ο = 2. 10 ot ο O 
ο 0 al 


By matrix multiplication and addition: 


1 0 O 1 
DOCERE? O A 
0 0 3 3 
1 0 0 2 
ο πας BR =2 Op + [1|-4 2 10| 0 
ο O J 
l 0 0 3 
ns οι ο M 
O O l 5 
Also, 1 2 3 


Eos Pa στ 2 er = le 
3 2 5 
Charnes! denotes two spaces used in linear programing, a "re- 


quirement space" containing the required condition vectors and the 
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tsolution space" containing the solution vectors. By means of linear 
transformation, it is possible to pass from one space to the other pro- 


vided the transformation of unit vectors is known or equivalently, the 


transformation matrix. If x4, Xo, «+X, are the original variables, 


and xi X^; eX are the new ones, they may be expressed: 


M 
A = Sr a a) 996959 An pn 
Xp = Anıkı + an2 +... Ann 
and the transformtion matrix is: 
471212 ecce ain 


3nl?n2 **** ?nn 


Denoting the transformation matrix by A , it may be written: 


xi SER X4 
t 

Χρ 22 

o i e 

ba Xa 


and solved for in terms of either set of variables, 


= Aml 1 

Xy cz A x 

1 

% % 
e e 

x x! 

n n 


Letting A”! be called a new matrix B with elements bjj : 
x 2b x'4 b x'4.-bx! 
me qr 01 uM Inn 


- ' 1 y 
X, = bjixi τ banks e... + ba Xn 


= + 1 1 
Xu z bul b 2*2 ο... T Sar 
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Convex Sets 

Theorems and proofs regarding convex sets, convex cones, and convex 
polyhedral cones are given by Charnes,? Blackwell and Girshick,? Gale, 19 
and Gerstanhaber.ll Gale states that the theory of polyhedral cones is 
equivalent to the theory of inequalities with the former being a geo- 
metric interpretation of the latter. 

A convex set of points is such that if two points are in the set 
then the line segment joining them is also in the set. Examples of con- 
vex sets are points, lines, spheres, hyperplanes, and half spaces.? Hy- 
perplanes are described by equation (2), and half spaces by equation (3). 

Theorem:! A linear transformation L from an n- dimensional 

space W takes a convex polyhedron K into a convex polyhedron 

L(K) , the image of K. 

A complete treatment of this transformation is given in reference 


(1); the following figure is taken from that publication. 


- 


U (n-din.) W (m-dim.) 
Requirement Space 


Py 





Solution Space 











Fig. lh Solution and Requirement Space 


The configuration of L(K) is determined by the transformation 
matrix but will always be an image of K . Here the convex set K of 


3 dimensional space is transformed into L(K) in 2 dimensional space, 








19 
the points θ1» 90» and e3 being transformed into points 51 Pos and 
P4 . 

A convex polyhedral cone is generated by the half lines out of the 
origin, or ray3, and the convex set. Fig. 3 contains a convex polyhe- 
dral cone with vertex at the origin and the triangular convex set formed 
by points Pp, Pg, and Po + Koopmans!? gives two equivalent definitions 
of convex polyhedral cones: 

Such a cone [convex polyhedral] can be defined either as the 

convex hull of a finite number of half-lines out of the origin 

(sum definition) or as the intersection of a finite number of 

halfspaces whose bounding hyperplanes pass through the origin 

(intersection en). 

An extreme point of a convex set is a point which does not lie in 
a segment joining two other points; they are the corners of a set such 
as (ei, es, e3) or (P4, P5, P4) of Fig. h. The extreme points are the 
points at which the linear functional, the objective, takes on its maxi- 
mum (or minimum) value. The general form of linear programming, the 


simplex method, provides a systematic method of examining every extreme 


point and of obtaining the solution required by the objective. 


Basis 

A vector space of m dimensions is spanned or generated by a set 
of linearly independent vectors. The number of linearly independent 
points or vectors for an m dimensional space is at most m and this 
set of points or vectors constitutes a basis of that space. A basis 
must consist of a set of vectors such that every vector in the space 
can be written as a unique linear combination of the set. Thus in Fig. 
2, the space generated by the rectangular coordinate unit vectors has a 


basis of its unit vectors. Also, vectors A and B can be considered 
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as a basis for the grid area bounced by vectors A and B , as all 
points on that grid space can be uniquely described in terms of the two 
vectors and scalars. 

The basis provides an initial starting point in the solution of 
linear programing by the simplex method. The number of linearly inde- 
pendent vectors, the rank of the matrix, determines the number of di- 
mensions involved in the requirement space. In practice the number of 
dimensions of the basis in the "simplex method" is determined by the 
number of restrictions that must be met. For example, in equetion (2), 
this would be determined by m . In the case of the transportation 


method the number of variables in the basis is m+n-1. 


Slack Vectors 

The general form for a linear program problem was given with the 
objective and restrictions expressed in terms of inequalities. The 
system of inequalities is changed to a system of equalities by adding 
new non-negative slack variables, sometimes called giveaway factors or 
disposal activities. In mtrix form, the slack variables form slack 
vectors, and yield an identity or unit matrix which provides an initial 
basis. Similarly, if the objective and restraints are set up in the 
form of equalities, artificial vectors may be used to provice a basis. 
In the case of a maximizing objective, a large negative "profit" value 
may be associated with the artificial vectors; the value itself need 


not be specified. 








GENERAL FORM CF LINEAR PROGRAMMING 


Simplex Method 
The general form of solution for any linear programming problem as 
developed by Dantzig,? is the simplex method. Charnes and Lenke 1-2 de- 
veloped the modified method, a procedure better adapted to machine com- 
putation. Special cases of the general method have been developed such 
as the transportation method and the assignment method. 
The general form as stated was: 


n 
(1) Maximize 5 C yx; 


j=l 
n 

(2) Subject to Z a4 5X5 < b; icc eee E 
jel 

(3) X; 20 j' 21323 2 5 


For m=3 and n= 3 , equations (1) and (2) take the following form: 
(h) Maximize Cix] t CX t C7Xz = 2 
(5) Subject to Β11Χ1 + 37 X2 + 2,3 € b4 

&5jXj * 852X5 * à54X4 = by 

< 

83131 + 81212 + ag, S Ba 
(6) = xj>0 j= 1l, 2,3 
Adding slack variables, inequalities of (5) become: 


! 
σ΄ 
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(7) 273%] + 372) + à44X4 + AYA, t aicXc t 836X6 
297X] + &55X5 t à54X4 t 854X) * &ogXc t ἂρρχ6 Ξ 
àjjX4 t 8459X9 f &44X4 t a4,X) t à4cXc * 846X& z 
x; 20 
Equation (7) is the form used in the simplex method of solution. The 
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addition of slack variables also changes the linear functional (Lh) to: 
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(8) Maximize Xj0, t X505 + XzC03 + Xp] Cy + XgCg Ἐ Χρος Ξ 2 

Before proceeding to a numerical example, features of (7) and (8) 
will be discussed; the terms used were previously described. The prob- 
lem is to find the values of X], X», Χη“»-».Χρ which maximize the linear 
functional z . There exists an infinite number of solutions, and 
through use of the simplex method the extreme points of the convex set 
are examined systematically in such a manner that the value cf z is 
obtained for a maximum in the final tableau, frame, or table. 

The column coefficients 844, aol» 831» «eeej A169 Ang» and 2% 
represent vectors in the requirement space W and the row values 
X13 Xo» X4» Xj» Xo» Xe» represent a vector in the solution space U. 
The colum coefficients aj; may be written as P,, P5 .... Pg and 


1) 
the constraints bj, bo, b as P, . Thus, (7) may be written as: 


(9) PX] + PoX» + P3X3 + "μπι, + PX + Pexa = Po 
pum 
With j 814 
223 
η 
Any set of x;'s which satisfy (9) is a feasible solution and the 


set maximizing the value of z , in (8), is the desired optimal solu- 
tion. The values of each aij and ο) my be positive, negative or 
equal to zero. For an objective of maximizing, meanings which may be 
associated with the 814» €3» and Xj were given previously for illus- 
tration, but they are not restricted to that interpretation. As first 
given, the objective was to maximize profit with z in terms of dollars, 
but the method can be extended to any unit of measurement, time, pounds, 


ton miles, etc., and involving purchasing, production, stockinr, selling 


or any similar function. 
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The development and proof of the simplex method in reference (2) 
was made under the assumption of nondegeneracy; degeneracy is the con- 
dition of having fever than m positive values of the unknown variable 
at some stage of the iteration process. This restrictive assumption 
was first resolved for the transportation method and later resolved for 


the general case by Charnes. l>» V; 


The dual problem to the general case my be written: 


m 
(10) Minimize = wb, 
i=1 
m 
(11) Subject to zx π811 50: Jemen 
gas 
Ws >0 i cg UE 999 ο] 


Here, the 8} 1» b, and cj have the same meaning as ín the original 

problem and the w; would be in dollars per unit time, a production 
cost. Note the change in direction of inequalities and the change of 
position for the bi and Cj o Here, slack vectors with a high pen- 
alty cost would be introduced in lieu of the original procedure. The 


general method of solution is the same. 


Exanple of the Simplex Method 
A problem that well illustrates the versatility of the simplex 
method is the production problem of references (15) and (16). The 
problem consists of producing two products R and S bya two stage 
process, initial operations must be performed in Machine Center I, and 
final operations may be performed in Machine Center IJA, IIAA or IIR. 
Machine Center IIA and IIB differ in that different unit production 


rates and costs are involved. In addition an amount of overtime is 








2 
available in IIA and is handled separately as IIAA. Unit production 
time, unit profit, and machine hours available per machine center are 
given in Table 1. 


A 1. Production Data 


Machine E WE UM R Product S Maximum No. 
Operations | Center 5], Sc EN Hours Avail. 
Initial 2 οι » O1 .03 .03 850 


«05 700 
Final ITAA 002 «05 100 
ITB .03 900 


Unit Profit LO 28.32 1.72 ECU OS 


There are 3 ways of producing R, and 3 ways of producing S; therefore, 
each way is considered to be a different product for computation pur- 
poses. Consider the initial problem to be: maximize the total profit 
utilizing the available data. There are no minimum quantities of either 
product at this time; a requirement of this type would be handled as an 
additional constraint. Let x}, x», X3, Χμ» Χο, and xg be the unknom 
quantities to produce of products Ry» Ros R4; Sh» S5; and 36 respec- 


tively. The problem may be stated: 


Find X15 X55 a =» 253 
6 
(12) Maximize = ουχη 5 
(13) Subject to Z aj; <b iz 145595 
x4 20 ο το ου" 5 
The 8448 are the unit production times of Table 1, the b,'s are the 


available machine hours, and the 15 are the unit profit for each 
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product. Algebraically the problem is: 


Maximize ey0x] + 2ᾶκρ 47 .32x4 + .72xj + «Ólxg +.S0xg = 2 
Subject to 
(15) «Olx, + .0lxp + .0lxz + .03x, + o03xg + .03xg < 850 
(16) «001 * .05xj, « 700 
17) .02x> + „05x < 100 
(18) „03x + .08xg < 900 


The last four inequalities are changed to equalities by adding 
Slack variables, x7 to (15), xg to (16), x9 to (17), and x9 to (13). 
The slack variables may be considered as fictitious products with cor- 
responding c 115 » unit profit, of zero dollars and therefore will be 
forced out of the desired optimal solution to (1). Equations (15) 
through (18) may be rewritten as: 
νι oc 05 uu toos "eo a 

n 110 > Es 


x; 20 j=1,2....10 


3 
matrix of (13) and of the slack variables. 


10 
or = P 5X5 = Po The P;'s are column coefficients of the aij 
j=1 


X4 20 

The data may now be put in the form of the simplex tableau, Table 
2. Pg has been placed on the left hand side of equation (19) for com- 
putational purposes. Equations (15) to (18), or equivalently (19), are 
in the form of (7), where some of the coefficients ajj are equal to 
zero. The unit matrix, formed by Pos Pg; Pos and Po; is the unit 
basis and provides a starting point in the simplex method. Here tne 
requirement space is fouredimensional, and the solution space is ten- 
dimensional. Henceforth, zeros in a tableau are indicated by a blank 


space. 
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Table 3 is formed from the preceding tableau, Table 2, by repeat- 
ing it and listing the basis vectors in the Basis colum, with the cor- 
responding Cj for each vector. The quantities of each product to 
produce are listed in the Pg colum. Thus, the basis automatically 
provides an initial solution; make 850, 700, 100, and 900 wnits of the 
fictitious products x7, xg, Xg, and x39 and none Of Xj, X5, X34, and 
Χμ; resulting in a net profit of zero. In effect, one extreme point 
of the convex set has been examined; the next step is to examine the 
other extreme points until the objective has been obtained. 

Two additional row values are inserted in Table 3: 23 and 2 1-03» 
Extreme points are examined by inserting various vectors into the basis 
and testing each tableau, by means of the 2 1-54 value, for an optimal 
solution. The value of each c; is given and its corresponding Zj 


is computed from 2; = 2 C435; y Where cy is the coefficient of the 
i 


P's in the Basis colum. 

The following conditions for Z ic 5 and the algorithm used in the 
simplex method are stated without proof; derivations are contained in 
references (1) and (2). 

Conditions of z y*3* 

I If any 2,7; <0 , and for every i, Xij SO then z is infinite. 

B If any 230; <0 , and for some i, Xij >0 , the objective has 
not been obtained and the simplex procedure is continued. 

UNI If all 51-93 ΣΟ , then the value of 2, is a maximum and the ob- 
jective has been obtained. 

Conditions II and III are normally encountered as condition I may 


be excluded when setting up the problem. In continuing the simplex 


procedure, following condition 11, each successive value of the linear 
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functional z increases until the objective is obtained. It should be 


noted that if there exists a 21-04 Ξ O , for some Ps not in the basis 
of the final answer, there are additional combinations of real products 
available but whose objective value will equal the present 2, . For 
all P's in the basis, z-c = 0 is always true. 

The next step is to bring into the basis some new colum Py vec- 
tor. Any Pj having a negative z-c is admissible, but the procedure 
is to bring in that P having the largest negative ᾖ7-ο value such as 
Pj * To determine which row vector, P, , to remove from the basis, di- 
vide each element in the P, column by each corresponding positive aij 
appearing in the P, column coming into the basis. The minimum positive 
ratio so formed determines the row vector to be removed. This ratio must 
be positive since the original conditions required the components of the 
P, vector to be non-negative, equations (19). 


For illustration the following general tableau is given: 







Vector {coming in 


Vector being Old Tableau 
removed tA 
.—— 


Vector coming New Tableau 


Let Ps = any colum vector. 
Pr = colum vector coming into the basis. 
Pr = row vector being removed from the basis. 


coefficient determined by the intersection of the P, colum 


Ὁ 
ES 
x 

H 


and Py row. 
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In setting up the successive tableaus, the vector coming into the 
basis is determined first. Py and PL are determined as previously 
stated and ark follows immediately. The FP, row may be written di- 
rectly by dividing through the old entire P, row by a, . 

All other rows may be determined by the following formula or al- 
gorithm. Derivations are contained in references (1) and (17). 
Let al; = any other new element. 

ài z corresponding old element. 

arj = old element in the same column and in the row removed. 

ai, = old element in the same row and in the column entering. 

ark = old element in the row removed and in the colum entering. 

aik 

πη a (1 ἐκ) 

The new tableau is completed using the above algorithn, 215 and 
the corresponding 2303 are computed and inserted in the tableau. 


Also the new profit value is given by 2 z z- 9 (zy-c) where: 


DUX 
n d. R the minimum positive ratio previously described 
1 ask 
in determining P, . 
D 20 


The maximum negative value of 23-764 determines the next δι 5 
the process is repeated until such time as there are no negative values 
of 2,015 and the final tableau contains the optimum solution. Also 


Ja 
a 
21-ο.- 2 = 103 
νι. 8x (zy 7c) 


the new Zz,-c. ER ; may be obtained from: 


In summary the 2 are needed to determine the P. to come into 


ie 
the basis. By choosing the most negative value of 2,703 » it often re- 


sults in a quicker solution, but not always. Knowing P, , it is then 
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necessary to determine the P, to be removed from the basis. These 


P 
two phases are the key to almost all special methods of linear pro- 
grarming. 

Continuing the example, the next tableau, Table lj, is constructed. 
The most negative Z4 3 is colum Pj , the Pi, indicated by the 


vertical arrow. The P. , row to be removed, is determined as follows: 


nin : NO 
E aik 
=< = 28,333 for Py , E - 11,000 for Pg 


Therefore, Pg , the ninimum ratio row, becomes the Pp e Colum head- 
ings Pg eec Pg and the c j values in the corresponding columns re- 
main the same and are omitted in succeeding tables for brevity. 

Each element in the old Pg row is divided through by the ark 
value of .C5, yielding 11,000 in the Po colum, el: in the Pz colum, 
l in the Pp colum, and 20 in the Pa colum. 


The elements in all remiining rows are conputed by the algoritm, 


a: 
P= oe... = sw a. : 


ij ij Ark ik 
a - E 
220 = 850 - (ο .03 = 30 
τος id 27) 


a! 2.01 - (.02) «03 c2 002 
1.05) 
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Bach element in the new table is determined as above. It should be 


noted that use of the algorithm sets up a square pattern with the 


initial a,, determined. The pattern is indicated as follows: 


81} aik 
ev 
φεοῦ 
ar Ark 


Essentially the algorithm states: The new element equals the old 
element minus the product of the diagonals divided by the a,, . 
Element a7g in Table l is obtained from Table 3 by the above pat- 


tern: 


a78 το. (.03)(1,) = οὔ 


The diagonal product may be left to right, right to left, and up 
or down depending upon the relative position of the ar, + The result- 
ing tableau is given in Table h. A shortcut to avoid computing each 
element when zeros are present will be discussed later. 

The 2115 are conputed for each column, and the corresponding 
c,'s are subtracted yielding the 2,0; row. The 2,7, are 
scanned for the most negative value, and the process is repeated un- 
til Table 9 has been obtained, the optimum solution. Thus, the sole 
tion calls for the number of products Rj, Roy Rz as indicated in the 
ES colum with the corresponding profit in the Z 4-64 entry. It also 


calls for 150 units of product X4 , but this was a fictitious product 


and is ruled out. Product S is excluded since it does not appear in 
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the basis. The program is summarized in Table 10. 


Table 10 


Optimal Program - Number of Units 


Product R Product S 
Rj (Centers I, IIA). . 35,000 units S, N 
Ro (I, IIMA)... . . 5,000 units Sc 2 z 
R3 (I, 11B). u. . 30,000 units Sg E 
Total profit $25,000 : 


Table ll summarizes the program in number of hours using the data 


of Tables 1 and 10. 


Table 11 


Optimal Program - Number of Hours 


Operation | Machine Product R Product S | Hours | Hours | Surplus 
Center Ri Ro R3 Sh Sg Sg | Used | Avail.| Hours 
IIA 700 0 700 700 


Final ο 
‘| IIA 100 0 100 | 100 0 
IIB 900 o| 900 | 900 0 


It should be noted that when a zero appears in the P„ row of any 
tableau, the entire colum in which it appears will be identical in the 
following tableau. Similarly, if a zero appears in the P, colum, 
the old row repeats itself in entirety. Referring to Table 6, zeros 
appear in row FP) for columns Po, P35 Po, Pes P2, Pos Pio, and those 


colums are identically repeated in Table 7. In Table 6, zeros appear 








3l 
in the Py colum, Pj , for rows Pg and Pg . Thus, rows Pg and Pg 
in Table Ó are identically repeated in Table 7. Because of the many 
zeros encountered in a typical linear programing solution, the algo- 
rithm need not be used for every element when the above conditions are 
present. The general form, the simplex method, has been criticized as 
a time consuming process; however, by properly utilizing various short 
cuts, the time involved is significantly reduced. A review of Tables 
3 to 9 will quickly verify the above statement. 

An inverse matrix is contained in each tableau if the initial tab- 
leau contains an identity matrix. 

Theorem:© If, in an initial ο. we have an identity 

matrix, then in this position in subsequent tableaus will 

be the inverse of the current basis. 

Referring to Tables 3 and l, the matrix formed by Pv, Pg, Po, 
and Pj, column of Table h, is the inverse matrix of the new basis, 
P2, Pj, Po, Pig of Table hl, as given by the Pz» Pp» Pg, and Pz 


colums of Table 3, 


Table 3 Table li 
Pos P Pos Pio P2; Pg; Po» Pio 
τ. $4.03 0 O 1-5 0 0 Ἱ ο ο ο 
O ο ο O O 20 O 0 ο αυ. O 
0 0 " O O 0 JL 0 = νυ Ὁ 
O 0 0 1l O O O 13 συ Ὁ 


Similarly, by tne same theorem, in each succeeding tableau an in- 
verse matrix will be in the same position as the previous identity ma- 


trix. In Table 5 a unit matrix is given by Po, Py, Po, and Pg » 
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Therefore, in the same colums of Table 6, the inverse of the new basis, 


Pos Puy Po, Pg of Table 6, will be given. 


Table 5 Table 6 
Pos Py, Fg, P Pos Pus Pos Pag 
1 0O O 3/00 1 ο o0 -3/8 3 090009 
ος Ze OOO 00312050 
O O OL OO Ps ο O 
om oO Ο 8/100 0 0 Ο 25/2 O 0 O 1 


Carrying the theorem further leads to the modified simplex method 
developed by Charnes and Lenke.13 This also leads to the basis for ev- 
ery "adjacent exteme point" method to date and most of the special meth- 
ods of solution. In the modified simplex method, the algorithm need 
only be applied to that part of the tableau under the unit vectors, and 


by one equation the x;'s and the z,-—. may be developed. The Py 


i J J 
is then determined, aj, and Li. developed, P, determined and the 
aik 


simplex algorithm applied as before. 

Referring to the last theorem, it is possible to develop all ele- 
ments in subsequent tableaus by its use. Using Table l for example, 
Po may be written: 

τ Ου ΝΌΟΣ o 
or in matrix notation, 
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Let B= [ P; P, Pg P10] απο ο. X7 
| x), 
Xo 
O 
hen, Ex = Py = | 850 
700 
100 
900 


Multiplying through by the inverse of B, B^- , the latter equation 


becomes: 


B^lmx 


BIP, 

or X= B P. 
Therefore, it is possible to obtain the new x; values by means of the 
inverse of the current basis matrix in the new tableau from the Pg col- 
umn vector in the old tableau. For example the X, in the Pg colum 


ο 
of Table l| can be obtained as follows: 


x, = 1(850) - .6(700) + 0(100) + 0(900) = 130 
x), = 0(850) + 20(700) + 0(100) + 0(900) = 1,000 
χο = 0(850) + 0(700) + 1(100) + 0(900) = 100 
X19 = 0(850) + 0(700) + 0(100) + 1(900) = 900 


Similarly new colum elements can be developed using the old P3 
column and the inverse of the current basis matrix. Elements of Py 
in Table illustrate this: 

Aj, = 1(.01) = .6(.02) + 0(0) + 0(0) = = .002 


0(.01) + 20(.02) + O(0) t 0(0) s  .h 


a2] 
a3) = 0(.01) + 0(.02) + 1(0) + 0(0) = 0 


0(.01) + 0(.02) + 0(0) + 1(0) = 0 
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Br 

It is to be noted that the inversion of a large matrix becomes in- 
creasingly difficult as the size of the matrix increases. 

The usefulness of linear programming in analyzing cost data for 
changes in initial restrictions such as minimum product requirements, 
available machine time, unit production rates, and unit profits is well 
illustrated by this problem. 

Initially, there were no minimum requirements of product S to 
meet obligations such as market demands. Assume a minimum of 8,000 
units of product S are required in addition to the initial conditions. 
The problem need not be reworked as the necessary data is contained in 
Table 9, the former solution. 

The z ¡ez row represents "opportunity costs." Thus the process 
given by Pg of Table 9 has the least value, .06, a value that will 
affect the total profit the least for any change to the production pro- 
gram. The next succeeding values for product S are e253 and .28, for 
Pg and Py respectively. Thus, Pg represents the best choice and 
will necessitate reducing the amount of X» produced, represented by 
Po in the basis. However, the initial condition on x, was that 
x; 20. 

Therefore, 2.555 S 5000, and for maximum benefit the inequality 
sign is dropped yielding: 29295 z 5000, or Sg = 2000 . 

Since 8,000 units of S are required, the remaining 6,000 units 
must be S], Sg or some combination thereof. The next lowest value 
of the 2,0, row is 253 Of Pg , requiring a reduction of x} pro- 
duced, represented by P3 in the basis. 

Therefore, 356 < 30,000, and this condition is satisfied for 


Sg = 6000. In addition, x3 is reduced by: (8/3)(6000) = 16,000 . 
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Table 12 summarizes the above results. In the first step the 
profit was reduced by (2000)($.06) = #120, and in the second step by 
(6000)($.253) = $1520. 


Table 12 


Optimal Program - Number of Units 


Product R | Product S 
R} (I, HA) . . . 35,000 ελ... EY 
R ο Sc Eu. er cam 
R4 (I, IIB) . . . 15,000 Sg e e e e e e . 6000 


Total Profit = 25,000 = (120 F 1520) = $23,360 


The Zj-cj row of Table 9 may also be utilized to analyze the ef- 
fect of changes to the hours available in each machine center. For 
21-61 5, δ, 9, 10, initially introduced as a result of the slack 
variables xX7, X8, X9, and Xjg „ the "opportunity costs" represent val- 
ues of additional profit for each additional machine center unit time 


of centers I, IIA, ITAA, and IIB respectively. 


From Table 9 it is more profitable to make additional time avail- 


able in centers IIA, IIAA, and IIB as indicated by the z of 20; 


Jg 
Li, and 10.6. 150 hours of surplus time is already available in center 
I and verified by 277 = O , the least profitable center to allocate 
additional time. Assuming the 150 surplus hours available are to be 
utilized but not exceeded, the upper limits for IIA, IA, and IIB are 
obtained as follows: 

Center IIA 150 + Hg (-.5) > 0, therefore Hg S 300 hrs. 

Center IIAA 150 t Ho (-.5) 2 0, therefore H9 < 300 hrs. 

Center IB 150 + Hàg(-.33) 2 0, therefore Hyg € 1150 hrs. 
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Allocation of additional hours to Center IIA, IÍAA, and 1[B, within 
the above limits, will increase the original total profit as follows: 

New profit = 25,000 + 20H, + UH, t 10.53, 
for 0 &Hg € 300, 0H, «300, Ox Ho & l50 

Change to unit production rates of Table 1, as a result of new tools 
or machines, may require a new solution of the entire problem. However, 
the use of the final solution of Table 9 in analyzing such a change can 
be shown in this problem. Assume that the machining time per unit in 
Center IIA and IIAA for product R can be reduced from .02 to «0175. 
The most profitable methods are Ry; R35 and Ro respectively. Allc- 
cating the total time available in Center IIA, 700 hours, requires L00 
hours in Center I. The next most profitable method is for product R3 ‘ 
and 900 hours of Center IIB are allocated. This requires 300 hours in 
Center I for procuct R3 . The 100 hours of Center IIAA is allocated 
for product Rn which in turn requires 57.1 hours in Center I. Table 
13 summarizes the new program. Profits are computed from the number 
of parts used in determining Center I hours and the initial data. The 
total profit does not take into account the improvement cost but does 
provide a figure of $2,198.€0 as a criterion for judging the worth of 
such an improvement. 


Table 13 
Optimal = for Machine Time of IlAp = .0175 


Machine EET TENE E Product S Hours | Hours 
Center S, 5 S6 Used |Avail, 


| 1 | 200 57.1 300 οσα πι | 850 | 


700 
100 100 
900 900 


Total Profit: — + πας. + 9,600 = $27,198.60 





Operation 








Initial 












ho 
Changes in unit profits may or may not require a new solution of 
the problem. In either event Table 9 may be utilized as an initial 
starting point by using the elements of that table and the new unit 
profits. The new 2: and Zz;-c. are computed; if all Z-=c; are 


J J d Je) 

positive the program is still optimm. If any 2-6: is negative, 
the simplex procedure is carried out until all such values are positive. 

Assume tbat after obtaining the program of Table 9, it is necessary 
to reduce the sales price of product R by $.0 to meet new competitive 
demands. Table ll is obtained from Table 9 by repeating the elements 
and inserting new c,!s , $.0h lower, for Rj, Ro, and R4 . Under the 
old program of Tables 9 and 1h, and the new unit profit figures, the 
profit is $22,200, a reduction of $2,800. With the new program of 
Table 15, the profit is $22,280, a reduction of ¿2,720 from that of 
the original solution. 

Table 15 is obtained from Table 1) in three steps. The P, , 
Pg , is determined by the z-c value of -.Oh, and Pp from the mini- 


X. 
mum ratio of . X. ,. In Table 15, Pg row is calculated by dividing 


215 
the old P5 row by the a,, of 2.5. New rows P} and P3 are iden- 
tical as in Table 1} in view of the zeros present in the P, and δι 


rows and colums rule. Thus, the "square pattern!" of the algoritim 


need only be applied to new row Po - Zj and Z sac 5 are then computed, 


all values of the latter are positive and therefore an optimal program 


exists. 
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The usefulness of linear programming in cost analysis is an impor- 





tant characteristic that should not be overlooked. The manufacturing 

process involved, depending upon its complexity, may cause difficulty 

in normal cost analysis. In an oil refinery problem, it was necessary 
to produce a minimum quantity of a product for goodwill purposes, and 

at little or no profit. Because of the process involved, it was found 
that to produce only the minimum quantity, the resulting costs were 


higher than they were to produce a quantity above the minimum. 
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Reference (17) illustrates a problem in planning an experimental 
program, solved by linear programming and game theory. Alternatives 
such as installing the plant without preliminary experimental tests, 


with bench scale, and pilot plant tests were considered. 








TRANSPORTATION METHOD? 13, 17, 19 
The transportation method is a special case of the general simplex 
method. It was originally considered by Hitchcock and by Koopmans. As- 
sume there are a], az ....2, homogeneous products at origins Ols Ope. 
000; 0.0.0, - These quantities are to be completely distributed to des- 


tinations Di; D> ...994 ese Dg in quantities bi, bo; eo ey e e e o Do e 


m n 
Total distribution requires that 2. a, - 2. bj + Let the unit cost 
isl jel 


of transportation from 0; to D; be c;; and the amount to be trans- 
ported be Xij . Tne objective is to minimize the total cost of trans- 
portation. A special case of the above method is know as the "assignment 
method" where all of the a,'s and b,'s are equal to unity. The trans- 
portation problem takes the following form: 

n m 
(1) Minimize 5 2 ο 14 

Jzel is 

n 


(2) Subject to >” Xij 
j=1 


aq i = as 2, 3 eee oil 


1 25 3 ..../l 


m 
(3) = X45 = by j 
ll 


Xij zo 
If a problem can be put in the above form, it is possible to use 
the transportation method. Written out in general fora for three ori- 
gins and four destinations, equations (2) and (3) take the following 


form: 
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nn 
X11 + X12 t X13 t xy, Ss a1 
X2] + X99 + X23 + X2 = a9 


X31 + X32 + X337 X9, 5,93 


X11 X21 X31 - by 
X45 X55 X39 = bo 

X13 X23 X33 = 54 

Xy, Xo), X4, 7 b, 


This could also represent three products and four machine operations. 
The transportation problem always has the above symmetrical form, equal 
number of rows and diagonals. In addition, there are exactly two co- 
efficients of unity in each column and all other entries are zero. 

In a production problem for example, the coefficients would rarely 
be unity for production rates. However, it is possible to change the 
coefficients to unity and obtain an approximate solution by two basic 
6 


operations: 


l. Multiplication of an inequation by a positive 
constant. 


2. A change in scale for certain of the variables. 

This procedure results in an approximate solution due to the round- 
ing errors introduced. "Normalizing" is the term used to describe the 
above operation which results in working with equivalent production units 
in place of the original production units. A complete description for 
handling the "normalizing" procedure is contained in reference (19). It 
also contains numerous examples as well as a general discussion of linear 
programming and the transportation method in particular. As in the sim- 
plex problem, artificial vectors may be used to handle problems where 


the total amount available does not equal the total amount required. 
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Fietitious origins and destinations with fictitious costs permit an op- 
timal program; all fictitious routes are forced out in final solution. 
By the above process a mathematical analogy may be made, where originally 
there was no apparent physical analogy». The construction of the mathe- 
matical model requires complete familiarity with the different methods 
of linear programming. 

The following problem illustrates the '"steoping stone" method, 


originally developed by Dantzig (18) and described by Charnes and Coo- 


per. S» ES It can be shown that the m+ n equations, (2) and (3), 
constitute m +n =~ 1 independent equations in m Xn Eis 
These equations therefore form a basis, and the minimizing solution 
will involve at most m +n - l routes with positive shipments. 

The stepping stone method consists in setting up an initial solu- 
tion by means of the basis. Tne ij elements are +1, - 1, orO. 
Thus in tabular form the x, is used directly in forminz the minimum 


m : x 
positive ratio .1. , The Ci, , cost of each ij route, is inserted 
Aix 
in the small comer boxes of Table 16 for ease in computation.  Quan- 
tities available are listed in the right hand column, and quantities re- 
quired in the bottom row. Initially an arbitrary number is assigned to 
Some row, normally the row containing the most stepping stone positions, 
the vectors in the basis. The Kj's for stepping stone columns are 
then determined from equation (lh): 
(L) δν ΓΚ” 5ο. where R4 z Row number 
K; = Column number 


Row and column values can then be computed for the remaining stepping 


stone positions by equation (L). 








ιό 
Row and colum values for the non-stepping stone positions, the 
vectors not in the basis, can be determined from R,'s and K.'s 


ayailatle. For the non-stepping stone positions the z is obtained 


ij 
from equation (5): 

(5) 233 = Ri +8; 

From equation (5), the 23-053 is computed for each cell not in the 
basis. The nor-stepping stone cell with the largest positive value of 
2147615 is then brought into the solution, and the stepping stone cell 


+ . e LJ . κ. . e . 
with the minimum positive _L_ ratio is removed. To bring a new vec- 
aik 


tor into the basis, it must be brought in by a path via the stepping 
stone positions by rook moves, as in chess. The amount brought in is 
added or subtracted alternately to the basis positions used. The amount 
brought in is subtracted from the positive cell and added to the negative 


cell. In the result of a tie for si, remove the most northwesterly 
ας 

value, and if the tie occurs in the same row remove the most westerly 

value. 


Nev Ri and K; values are determined, the non=ctepping stone 


21345 determined, and the process repeated wmtil all of the 255755 
are negative or equal to zero. For non-stepping stone cells with 
511-041 equal to zero, it indicates an alternate route with the total 


cost equal to that of the present solution. 


Example of Transportation Method 
For a problem with two origins, three destinations, and correspond- 


ing transportation costs as given below, the use of fictitious values 
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is shown for the case of Za; 7 Συ. . The objective is to obtain the 


lowest total transportation cost and fulfill all requirements of the 
destinations. 


60 units requ'd 







Dy 






$9/unit $3/unit 


| ., 70 units req'd. 

100 units $7/unit D $u/unit 0 80 units 

available 1 $10/unit e 2 available 
3 


LO units req'd. 


Algebraically the problem takes the following form: 
Minimize 9%, + ΤΧ12 + 10x44 + 3x5, t lix,» t Χρ 
Subject to A κιτ X73 $ 100 


X90, + X00 + X23 < 80 


X13 + X07 = 60 
X13 + X23 = 0 
Xi; 20 


Since there are 10 more units available than are required, a fictitious 


destination is set up, and a zero transportation cost assigned in order 


to insure such a route is utilized for the excess supply. 


With the fictitious destination, the above equations take the 
following form: 
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9X1; * 7xj5 t 10x44 t Oxjp + 3Xp3 + Lx t+ 5X23 + Oxon 
x44 πρ t χ13 t XJF = 100 
80 


X91 * Xoo t X54 t Xop 

X11 + XR = 60 
X45 ο X55 STO 

LO 
10 


= + X93 


ΧΕ TE 
Xij » 0 
Due to the characteristics of this type problem, the problem may 


be reduced to the tabular form of Table 16 for computation purposes. 


Table 16 





Table 17 is constructed from the data of Table 16. Since the number 
of vector elements in the basis is five (m+ n - 1), an estimated solu- 
tion may be written dovm immediately. For a systematic approach, par- 
ticularly with a large matrix, it is convenient to start at the northwest 
corner, work across and down, balancing requirements at each step. This 


procedure is used in Table 17, total cost is $110. 








μ9 


Table 17 






Rules in establishing row and colum values, R}; and κ. » for the 


stepping stone positions are sumarized belom;© 


1ο 


2. 


3. 


6. 


Arbitrarily assign O to a rowe 


Move eastward along the row until you encounter the first 
vector in the basis. 


Assign to the colum the value necessary to cause the row 
and colum sum to equal the cell coefficient. [Equation (l)) 


Duplicate the process for all cells in the row which are 
included in the basis. 


establish row and column values for cells not in the basis; 


Proceed to determine any other row number by selecting a 
vector within the basis for which a colum number is avail- 
able. 


Carry through this procedure until all row and colwm nim 
bers have been determined. 


Applying the procedure to Table 17, assign zero to Ro ‚„ this deter- 


mines the Ko, K4, Kj of 4, 5, O respectively by equation (4). R, may 


then be found from K, and equation (4), equal to 3. K, is then de- 


termined by the sane equation. The z,.'s for cells 13, li, and 21, are 
a 


found by equation (5); the corresponding cj;'s are subtracted, giving 


values of — 2, +3, and + 3 respectively. Cell 21 with the largest 


positive 711041 + 3, is the vector to be brought into the basis, and 


cell 22 with the lowest positive {i_ ratio, 30, is to be removed from 


ar 
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the basis. Here, two cells resulted in a tie by the +3 value. Ina 
matrix, rows may be interchanged and colunms may be interchanged. Inter- 
changing ror l and 2 would result in cell 21 becoming the most north- 
westerly cell, applying the rule for case of a tie, requires cell 21 to 
be brought in. Cell 21 is brought in via the stepping stones by rook 


moves. Note, Po, may be written: 


(30) (40) (60) 
ra er πο AS 


The a;y's are +1, - 1, or O, and the plus and minus signs within 
each cell refer to each ajẹ of the path. To determine 8 , only the 


F's with the +1 coefficients are considered, Poo and Py, . Minimum 


x 7 
E » 15 + ; the amount to be removed is 30 for a reduction in cost 
a. 
ik 


of $3 X 30 or $90. Total cost is $1140 - $90 = $1050. The new program 


is given in Table 18. 


Table 18 





New row and column values are determined and showm in Table 18. The 

543-011 for non-stepping stone positions show that Cell Ji, a differ- 
ence of -FÓ, must be brought in through stepping stones P44, P5j, and 
Pol, with minimm 9 at Po, ; therefore Pop, is removed. Reduction 


in cost is $6 X 10 = $60, total cost of $1050 - $60 or $990. The 








5 
program is given in Table 19. 


Table 19 








New row and column values are determined, given in Table 19, the 
2137013 differences computed, P13 is brought in, P,, removed, and 
the cost reduction of $20 is obtained, $1 X 20. The program is given 


in Table 20 at a total cost of 2970. 


Table 20 








New row and column values are assigned and given in Table 20. The 
21375 for all non-stepping stone positions are negative and an op- 


timal program has been obtained. If any of the 2,570 for the above 


ij 
positions were equal to zero, such a cell would represent an alternate 


route but at the same total cost. 


Example of Transportation Method, Fictitious Route? 
To illustrate other considerations concerning the transpartation 


method, the following example is given.  Procedural explanation is 
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omitted except in calling attention to specific considerations. Tables 

21 and 22 show the successive stages obtained through the steps pre- 
viously discussed, The problem EE 3 origins and 5 destina- 
OS Cost data and quantities are given in Table 21. The allocation 
to routes was made by starting in the northvest corner and proceeding 
across and down. The requirements are fulfilled by six cell values, 
excluding the zero. However, in this method the number of vector ele- 
ments in the basis for an m by n matrix is (m+ n- 1). Therefore, 
7 vector elements must be used (3+ 5-1) . The optimal program may 
consist of less than (m--n - 1) routes as in this example; however, dur- 
ing the iteration process all possible basis vectors must be considered 
at each stage. To fulfill the requirement of Y vector elements in the 
basis, zero is arbitrarily assigned to 02 Do « The zero could have been 
assigned to any of the 9 remaining cells available, and this would re- 
quire different row and column numbers than given in Table 21. The trans- 
portation method is carried out, Po), removed and Pos brought in. The 
optimal program is then given in Table 22. 

There are 5 non-stepping stone cells with 214-6ij equal to zero, 
cells 13, 21, 31, 32, and 33; therefore, those cells represent alternate 
available routes at the same cost as the program of Table 22, $230. 

When there is more than one basic solution the other solutions consist 
of a convex linear combination of the basic solution. Because the cost 
data is a matrix, if a number, positive or negative, is added to any en- 
tire row or to any entire colum, the new problem is equivalent to the 
old for an optiml program.® By subtracting 3, 4, 5, 6, and 2 from col- 
ums 1, 2, 3, 4, 5 respectively, adding 2 to row 1 and adding 1 to row 


2, the "cost" data of Table 23 is obtained. The route can be programmed 
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according to the new relative "costs"; the - 5 "cost," cell 3lı, may be 
viewed as a subsidy route with the maximum amount to be shipped via that 
route. The +5 "cost" of cell 15 is avoided by use of the many alternate 
routes of O "cost." The program may be set up to meet all requirements 
and the total cost obtained through the use of the original cost data. 

The transportation method permits cost analysis similar to the sim- 
plex method, for factors such as: what cost increase is permissible for 
some particular route to meet competitive conditions and still maintain 
an optimm program; where to ship, produce, store; and similar functions. 
The objective of maximizing some functional may also be used in the 
transportation method. Symonds}? discusses an oil refinery problem of 
allocating crude oils to several refineries in order to obtain maximum 
possible profit. The problem, a 5 X 10 matrix, is solved by h4 itera- 
tions. 

In the two previous illustrations, a separate table was used in 
each iteration for clarity. In practice, all iterations may be carried 
out using one table by crossing out old row and column numbers and cell 
elements changed. It is a characteristic of this method that there will 
be no undue buildup of changed values in any one cell. Furthermore, 
there is no need of rechecking calculations for errors as a positive 
check is provided on completion of each iteration by the use of new row 


and colımn values. 


Sh 


Table 210 














Table 226 





6 


Table 2 











ASSIGNMENT METHOD 


Example of the Assignment Method 


6 is a special case of the transportation 


The assignment method 
method and is illustrated in a problem of assigning four men to four 
jobs. It is assumed that each man is capable, to some extent, to per- 
form each job. Furthermore, it is assumed that the degree of competence 
can be expressed by some numeric value, such as a score. The men and 
corresponding job competence in each job is indicated in Table 2h. The 
objective is a balanced job assignment; it is desired to obtain a maxi- 
mu total score over all jobs, where a high score indicates competence. 
The method may be used to maximize or minimize as in the simplex method. 

The method consists in "shipping" fractions of men to the various 
jobs; mathematically the problem 1516 


πι 
laximize (or minimize) £ X cit; 


i=l j=l 


total man required on the jth job = 1 man 


m 
Subject to = x; 


ii Ὃν 
n 
> Xi3 2 total amount of itR man assigned = 1 man 
jl 
τ sth sth 
Xiz 2 amount of i man assigned to the j job. 
C14 = score of ith man on jth job. 
X; 20 


The assignment method is possible because of the following theorem: 


Theoren:Ó In the transportation problem when marginal data are 
integers, every basic solution cames out in integers. 


In view of the above, x must be O or 1 in each basic solution of the 


ij 
problem. To minimize total score, Table 2lı may be used directly; to 
55 
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maximize the total score, the scores must be changed to negative quan- 
tities. Thus maximizing the original score is equivalent to minimizing 
the negative of the score. 

To maximize total score, Table 25 is obtained by changing the scores 
of Table 2) to negative quantities. Table 26 is obtained by subtracting 
the lowest number (- 97), from every number in Table 25, resulting in 
all positive scores. 

For each iteration process, draw the minimum number of horizontal 
or vertical lines which will cross out all zeros in the array. Look 
for the smallest number in the array which is not under any of the above 
lines. Subtract this number from all numbers not crossed out by the 
horizontal or vertical lines. The process is repeated until there is at 
least one zero in every row and colum. This condition will occur when 
the minimum number of horizontal and vertical cross out lines is equal 
to the number of rows or colums. From these zeros, select the zero so 
that it is the only one in each row and column. The optimal program is 
given in Table 31 as marked by the asterisks: man 1 to job h, man 2 to 
job 3, mn 3 to 2, and man to job 1, total score is equal to 339, 

(97 + 63 + 89 + 90). 

The above solution requires 5 iterations from Table 26. By utiliz- 
ing the matrix characteristics of the array of Table 26, the answer may 
be obtained in 1 iteration. Any number may be added or subtracted to 
an entire row or an entire colum in a matrix. Therefore, Table 32 is 
obtained directly from Table 26 by subtracting 18 from row 2, 3 from 
row 3, and 7 from row 4. Table 33 is obtained by subtracting 5 from 
colum 2; no further zeros can be obtained in this manner. The assign- 


ment method, minimum number of horizontal or vertical lines to cross 
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out all zeros, is applied, 16 subtracted from the remaining array, and 
the optimal program of Table 3l obtained. The latter is identical to 
Table 31. 

The methods discussed work only for a square matrix. However, the 
procedure can be used when the original matrix is not square by use of 
fictitious values and corresponding high or low "penalty" values which 
permit solution as described in the transportation method. In addition, 
the numerical score of this problem could have been replaced by time 
per unit, cost per unit, quality scale per vendor, etc., depending upon 


the application. 








Table 2) 

Ji Jo J4 J|, 
M 31 34 73 97 
I 5 50 63 7 
M37; 89 9h 32 
057 ἐρ 31 


Table 27 
My -66—63—2h —0— 
Μο 39 lh 31 15 
M3 57_5c—0o—62- 
M, DES; 52 57 


Table 30 
Mo 2h 2h 16 ο 
E 
E 

Table 33 


Mi 66 58 2h i 
Mo 2h 21 16 Ὁ 
M3 


Μι 


Table 25 
Jy Jn 234 9 
-31 -34 -73 -97 
-55 -50 -63 -79 
-37 -89 -9h -32 
-90 -57 -h2 -37 


Table 28 
ερ 63 ron 
35 ho 27 11 
57 5---θ- 6ὲ-- 
Z0 h ο το 


Table 31 


Table 3lı 
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Table 26 
οὮ 45 J3 JJ, 
66632 aro 
42 47 34 18 
6O 8 3 65 
7 20 55 60 


Table 29 


Table 32 
66 63 a ο 
2; 29 16 0 
yp) Ue 
ο wea 











DUAL THEOREM 

The "dual" problem, previously mentioned, is developed in refer- 
ences (1), (L) and (6). The geometric concept of the direct problem and 
its dual problem is illustrated for a two-dimensional problem in ref- 
erence (21). The value of the dual problem is centered on the theorem 
that if a solution exists to either the direct problem or its dual, then 
a solution to the other also exists. In the notation previously used, 
the theorem states: 


max. 2 C5x4 = min. 2 wibi 
J i 


Thus, in formulating the model, it is possible to work with either 
the direct problem or its dual, and the solution of either automatically 
provides the solution of the other. The answer to the dual, the wi's , 
may be read directly from the final tableau from the 205 row in the 
columns associated with the initial slack vectors. The wi , an "oppor- 
tunity" value, in the dual problem provides information on the rate of 
change of the functional with changes to the capacities or constraints 
of the problem. There is no method of determining which form of the 
problem will yield the easiest solution. It is recommended that both 
forms be examined before attempting to solve either form.? 

Use of the dual theorem is made in reference (22), a warehousing 
problem with multiple products and varying prices. It also illustrates 
special computational features possible due to the structure of that 


problen. 
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SUMMARY 

Two important phases of linear programming are formulation of the 
mathematical model and the computational aspects. 

The majority of linear program examples published to date involve 
one or more of the methods presented. It is to the advantage of manage- 
ment and industrial engineers to become acquainted with the basic methods 
and capabilities of mathematical programming, particularly in industries 
that do not maintain a staff versed in this field. By doing so, some of 
the necessary groundwork can be handled by present personnel to reduce 
the time and expense in utilizing consultants when required. Formulat- 
ing the matheratical model requires personnel who are thoroughly quali- 
fied in the use of tbe varicus techniques, and this phase determines the 
success or failure of the whole process. 

For a large problem, solution by computer is the only efficient 
means, not because of the complexity of the mathematics but due to the 
quantity involved. A transportation problem of 25 origins and 60 des- 
tinations required nine man days by hand computation technigves. An 
IBM card programned calculator can solve a 20 by 20 matrix in about 
three hours. The Rand Corporation (23) simplex code can solve 100 
equations in about five hours, and their code for a transportation type 
problem can solve a 300 equation system in about one hour. 

Rental time at data processing centers, located in various parts of 
the country, offer one possibility for small companies unable to justify 
the large capital investment of a computer. 

References (2) and (25) discuss methods of machine matrix inver- 
sicn. The method of reference (2h) is not well suited to desk calculator 
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